System for simulating events in a real environment

ABSTRACT

A system is disclosed for simulating events in a real environment containing static objects and dynamic objects that includes a position locating unit for continuously determining the real environment the position of the dynamic objects in relation to the static objects within a time period in which the even takes place; storage elements for storing data describing the dynamic and static objects of the environment; and processing elements for processing data from the storage elements; d) display elements for displaying a simulated view from a selected viewpoint on the simulated environment; and control elements to repeat the functioning of the processing and display elements for a range of consecutive time moments.

CROSS-REFERENCE TO RELATED PATENT APPLICATIONS

The present application is a continuation of U.S. patent applicationSer. No. 12/106,263, filed Apr. 18, 2008, which is acontinuation-in-part of, and claims priority to U.S. application Ser.No. 10/031,575 filed May 13, 2002 now abandoned, which is a continuationof International Application No. PCT/NL00/00513, which designated theUnited States, and was filed on 21 Jul. 2000, published in English, andwhich claims the benefit of the Netherlands priority Application No.1012666, filed on Jul. 21, 1999. Each of the above applications areentirely incorporated herein by reference.

FIELD OF THE INVENTION

The present invention relates generally to the field of computer games.More particularly, the present invention relates to systems forsimulating events in a real environment containing static objects anddynamic objects.

BACKGROUND OF THE INVENTION

Systems of this type are already known from the prior art. An example isdescribed in EP0773514. This prior art system is specifically destinedto simulate games, sporting events, etc. which take place on arelatively restricted area. Each of the players or competitors in thegame carry a transponder and also other moving objects, such as a ballin a ball game have a transponder installed therein or thereon. In thedirect vicinity of the area where the game is played a number ofreceivers is installed which do receive the signals from the varioustransponders. Each transponder transmits an identity code so that therespective transponder can be recognized. Because the transmittedsignals are received by a number of receivers it is possible todetermine the exact position of the respective transponder based onphase measurements. Position locating means of this type are known assuch and do not require further explanation. The data, obtained by thevarious receivers is transferred to a processor for calculating thevarious locations and the location determining data is used forcontrolling display means on which a simulation of the real environmentis made visible whereby the simulated dynamic objects do move in thesimulated environment in the same manner as they move in the realenvironment.

Before each event a transponder has to be installed on each of themoving objects and at least three receivers (preferably more to increaseaccuracy) have to be installed in the direct vicinity of the area wherethe event will take place.

Another prior art system is described in W09846029. In this system theposition locating means are embodied as a video system comprising anumber of television cameras installed at fixed points around the areaon which the event will take place.

Each of the cameras provides information about each of the dynamicobjects and because each of the cameras has a different view point andsees the various dynamic objects from a different viewing angle it ispossible to calculate from this information the exact location of eachof the dynamic objects at any moment in time. The more cameras, the moreaccurate the location can be determined, however, the more calculationshave to be performed to obtain the desired results. Before each eventthe cameras have to be installed at fixed places, the exact location ofeach of these fixed places in relation to the real environment has to bedetermined very accurately.

In FR2726370 a system is described for providing data about themomentaneous location of each of the players in a game or competitors ina sporting event. The object of these systems is not to gathersufficient data to be able to obtain a simulation of the realenvironment. The actual object is to provide the arbiter or otherofficials following the game or the sporting event with sufficient datato be able to take, if necessary, the correct decisions. Two embodimentsare described. In the one embodiment a transponder system is used asdescribed in the first above mentioned publication whereas in the secondembodiment a television system is used as described in the secondabovementioned publication.

SUMMARY OF THE INVENTION

A disadvantage of said prior art system is, that before the event willtake place either television cameras or radio receivers have to beinstalled around the area. The mutual location of these devices has tobe adjusted or measured very accurately. After the event the cameras orreceivers have to be removed. Especially in the television cameraembodiment significant calculation power is necessary to obtain thedesired location position data from the various images.

An object of the invention is now to provide an improved system in whichthe disadvantages of the prior art systems are eliminated.

The invention relates to a system for simulating events in a realenvironment containing static objects and dynamic objects, said systemcomprising: a) position locating means for continuously determining inthe real environment the position of said dynamic objects in relation tosaid static objects within a time period in which the event takes place,b) storage means for storing data describing the dynamic and staticobjects of said environment, c) processing means for processing b1) datafrom said storage means describing the static and dynamic objects b2)data from the position locating means indicating at a certain moment themutual positions of the static and dynamic objects of the environment,said processing means being loaded with simulation software, d) displaymeans for displaying a simulated view from a selected viewpoint on thesimulated environment as result of the processing by the processingmeans, e) control means to repeat the functioning of the means mentionedunder c) and d) for a range of consecutive time moments which togetherdetermine the above-mentioned time period.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be explained in more detail hereinafter withreference to the attached drawing.

FIG. 1 illustrates a first embodiment of a system according to theinvention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

In agreement with said object the invention now provides a system forsimulating events in a real environment containing static objects anddynamic objects, comprising: a) position locating means for continuouslydetermining in the real environment the position of said dynamic objectsin relation to said static objects within a time period in which theevent takes place, b) storage means for storing data describing thedynamic and static objects of said environment, c) processing means forprocessing b1) data from said storage means describing the static anddynamic objects b2) data from the position locating means indicating ata certain moment the mutual positions of the static and dynamic objectsof the environment, said processing means being loaded with simulationsoftware, d) display means for displaying a simulated view from aselected viewpoint on the simulated environment as result of theprocessing by the processing means, e) control means to repeat thefunctioning of the means mentioned under c) and d) for a range ofconsecutive time moments which together determine the above-mentionedtime period. characterized in that said position locating meanscomprises a satellite navigation system, or a thereto-related system.

As such satellite navigation systems are known from the prior art. Inwide spread use is the GPS (Global Positioning System). GPS receiversare generally available and are used e.g., for navigation on board ofthe ships, to assist surveying operations, etc. GPS is based on an oldersystem named Naystar (navigation by satellite timing and ranging). TheGPS system is operated by U.S. military authorities. A similar system,called Glonass, is owned and operated by Russian authorities.

For improved accuracy furthermore so-called differential GPS receivers(DGPS) are known. Thereby use is made of a local reference of which thelocation is accurately known. By applying a correction on the GPS databased on said reference the general accuracy can be improvedsignificantly.

The use of GPS for locating competitors in a competition or players in agame is already known from the prior art. A first prior art system isdescribed in NL9301186.

According to this Dutch publication each competitor in a competition oreach player in a game carries a GPS receiver which is connected bysuitable means to a transmitter. The positional data, calculated by saidreceiver based on the signals received from the various satellites, aretransferred to the transmitter and transmitted to a central station. Thecentral station receives in this way positional data about allcompetitors or players which data is used by the arbiters or otherjudging or controlling staff for taking correct decisions. In otherwords, the positional data is not used to control the generation of asimulated real environment in which the simulated players are behavingexactly in the same manner as the real players in the real environment.

Another prior art system is described in U.S. Pat. No. 5,731,788. Alsoin this case each of the competitors carries a GPS receiver connected toa transmitter to transmit the positional data of each competitor to acentral station where said data can be used for following the event moreclosely. Also in this case nothing is said about using the positionaldata for simulating competitors in a simulated real environment.

In principal any display can be used to make the simulated environmentvisible to the user. However instead of a pc screen etc. moresophisticated display units as described e.g., in U.S. Pat. No.5,674,127 can be used. This patent describes a multi user game and hasnothing to do with a simulation of a real environment.

Although all the means necessary to provide the simulated environmentcan be positioned in the direct neighborhood of the real environment(for instance for control purposes) in general these means will beinstalled elsewhere.

A specific embodiment of the invention is therefore characterized inthat the storage means, processing means, display means and controlmeans are installed as a user terminal at a place remote from the realenvironment and that transfer means are used to transfer positional datafrom the position locating means to the storage means.

More in general the system will be embodied such that for each user ofthe system storage means, processing means, display means and controlmeans are installed as user terminals at a place remote from the realenvironment and that transfer means are used to transfer positional datafrom the position locating means to all said storage means.

It is preferred that the transmission medium, along which the positionaldata are transferred from the real competition environment to thesimulation system, is embodied by the internet. A large advantagethereof is that the positional data can be made available at a certainsite and that a varying number of users, from a very small number to avery large number can log in to this site and are able to fetch thepositional data into their system. Disadvantage of the use of theinternet may be that a certain delay will appear between the moment ontowhich the positional data are recorded in the real competition and themoment at which the positional data are available in the system. Afurther disadvantage can be that in case of popular real competitionsthere are so many people who want to log in onto the site that overloadmay occur so that it is likely that part of the users cannot be providedwith the necessary data.

If one wants to eliminate this disadvantage then it is preferred to makeuse of a telephone network as transfer medium (wire bounded orwireless). Also in that case a certain delay will take place over thetelephone network but said delay can, especially if the competitionenvironment is not too far from the system, considered as neglectible.

It is not necessary under all circumstances that the positional datawill be used in the system such that the competition within thesimulated environment is synchronous with the real competition (apartfrom the above indicated communication delay). It is also possible thatall positional data together with the corresponding time data are storedon a suitable memory medium and that said memory medium is used astransfer medium. In this embodiment the user may activate his system atany voluntary moment and may “join” a competition, which has taken placein the past.

In the last described embodiment it is preferred that the memory mediumis formed by a compact disc (shortly noted as CD) (or similar products,or products derived there from). Other memory media include hard diskdrives, networked storage, and electronic storage, such as random accessmemory (RAM), flash memory cards, and the like.

To maintain the system up to date over a longer period it will benecessary to update the data about the competitors. In reality notalways the same competitors will be present in succeeding competitions.To make adaptations possible it is preferred that the system comprises acompetitor database in which data are stored about a number of possiblecompetitors so that, after the competitors for a predeterminedcompetition are known, the simulation of the real competitors within asimulated environment can be adapted.

Although a certain database can be filled with data about a large numberof competitors such, that it is assured that during a certain period thecompetitors of the real game are in any case stored in the database,after a certain time it will be necessary to add new data. In thatrespect it is preferred that the data about competitors which are not inthe database can be added through a suitable transfer medium from asuitable source to become stored in the competitors database.

Because competitions are not always held in the same environment or onthe same track it is preferred that the system according to one of thepreceding claims, comprises an environment database in which data abouta number of possible competition environments are stored so that, afterthe specific environment where the competition will be held is known,the simulation of said environment can be adapted to the choice of thereal environment.

In general the number of tracks for a specific sports or competition orthe environments for a certain event are restricted. Adding or deletingenvironments is not very likely but not inconceivable. In that case itis preferred that data about an environment which is not contained inthe environment database can be transferred from a suitable source tothe system through suitable transfer means to become stored in saidenvironment database.

To make the simulation of the environment as realistic as possible it ispreferred that the simulation of the environment can be realized bymeans of images, which are taken on the real environment by suitablemeans.

The invention will be explained in more detail hereinafter withreference to the attached drawings.

FIG. 1 illustrates a first embodiment of a system according to theinvention. The system comprises a computer 10 with a display screen 12,a keyboard 14 and a joystick 16. The computer 10 is loaded with softwarefor simulating a competition environment on the screen 12 of the system.This competition environment comprises a predetermined track along whicha number of competitors are able to move between a starting position anda final position. The track is displayed from the standpoint of the userof the system, which in fact is one of the competitors in the simulatedcompetition environment. In the momentaneous state the screen of thedisplay unit 12 shows part of an auto race track whereby at the leftside in front of the user another competitor is visible. The user isable to influence its own speed and direction by means of the joystick16 or by means of another input device, such as a steering wheel.

Systems of the type as described above are generally known as so-calledcomputer games or computer animations whereby the user has thepossibility to compete as it were in a race.

To significantly improve the illusion of “reality” in agreement with theinvention a relation is established between the simulation on the screen12 and a real game from a real circuit. In FIG. 1 a real circuit isindicated by 20 and on this circuit a race is in progress with amongstothers the competitors 22, 24 and 26. Each of the competitors carriesapparatuses by means of which continuously data about the momentaneousposition of the competitor on the circuit can be transferred to acentral post 28. The positional data can be collected for instance bymeans of a GPS receiver installed in each vehicle which receiver bymeans of a number of GPS satellites, one of which being indicated by 30in the figure, is able to determine accurately its own position. Thedata supplied by the GPS receiver determines therefore at any momentaccurately the position of each competitor on the track 20. Thesepositional data can now be transferred through a communication network32 to the computer 10. The computer 10 in this application is loadedwith software which has the ability to simulate the real track 20 on thescreen 12 in an accurate manner and with very high reality content. Theuser of the system will get the impression that he is driving on thereal track 20. Furthermore the software is embodied such that othercompetitors are simulated on the screen at those positions on thesimulated track which correspond to the positions on the real track 20where the competitors 22,24,26 etc. are present in reality. If the useron the simulated track 20 for instance will take a momentaneous positionbehind the real competitor 22, then on the real track 20 this can beindicated by means of the virtual competitor 34. The user of the system,which plays the role of said virtual competitor 34, will on his screensee the simulated real competitor 22, which in FIG. 1 is indicated by 22a.

Above it is assumed that GPS receivers are used for locating thepositions. On the one hand not all GPS receivers will be suitable forthis application. Normally GPS receivers determine the position with anaccuracy of some tenths of meters. However, if a correction is appliedthen the accuracy increases less then a few centimeters. An example of acorrection means is for instance the so-called DGPS system which isknown as such. Within the scope of the invention preferably receiverswith such a correction are applied. On the other hand however it is alsopossible to use other position determining means, for instance on thebasis of laser measurements, transponders in the track road etc. Assuch, various kinds of means for position determining are known andfurther details are considered superfluous.

The data network 32 may comprise a telephone network whereby both wiresbounded as well as wireless telephone networks and eventual combinationsthereof are conceivable. The advantage of a telephone network is thatthere is almost synchronism between the real competition on the realcircuit 20 and the simulated competition on the image screen 12. Thedisadvantage of using the telephone network is however that in generalthe costs for taking part in a complete competition of for instance twohours may increase significantly. Therefore it is preferred to use,instead of a telephone network, for instance the internet. The usershould have an internet connection and should be able to log in throughthis connection onto a specific site where continuously and with theleast possible delay position data of all competitors in the realcompetition are made available. These positional data are continuouslyloaded in the software running on the computer 10. Said computer 10 isthereafter able to perform the simulation on the screen 12 such that thesimulated race on the screen 12 is almost synchronous with the real raceon the real circuit 20. The advantage of this method is that, in casethe site has enough connections available and has a sufficientaccessibility, a large number of users may “take part” simultaneously,each with an own system to the real race on the circuit 20.

Instead of the internet also use can be made of television networks. Thepositional data are in that case transferred through the teletext systemto the users. Eventually the screen of the television receiver can beused for visualizing the simulation instead of the computer display.

Until so far it is assumed that the simulated competition concerns anauto race. However, the invention is not restricted thereto. Instead ofan auto race it could concern a motor race, a bicycle competition, arunning competition, a horserace, races with powerboats or sailingvessels, military exercises etc. Furthermore it is not necessary thatthe competition be performed at closed circuit such as the circuit 20 inthe figure, whereby the race is performed over a certain number ofrounds. Instead thereof the track may consist of a single track betweencertain starting point and a certain final point. In this way it is forinstance possible to simulate tracks of bicycle competitions such as theTour de France, etc. on the screen of the system. However, it will beclear that heavier requirements will be put to the memory capacitor ofthe computer because the track data of a much longer track have to bestored in the computer.

Because competitions do not always take place on the same track it ispreferred that the computer 10 has memory means for storing a number ofcompetition environments. Therewith the user of the system is able,notwithstanding the place where the race is being held, to take part inthe race because the correct environment can be called up from thememory.

In a similar manner it is preferred that the system 10 comprises amemory in which the data about a large number of real competitors arestored dependent on the competitors which at a certain moment are takingpart in a real competition, the respective data of the competitors canbe called up from a memory and therewith the real participatingcompetitors can be simulated on the screen.

In order to manage interactions between the real-world dynamic objectsand the simulated object, the software running on the computer 10includes an artificial intelligence (AI) engine. In some embodiments,the AI engine includes collision detection to manage (i.e., prevent)collisions of the virtual competitor 34 with a simulation of the realcompetitor 22. This can be accomplished an interaction boundary aroundthe virtual competitor 34, the real competitor 22, or each of thevirtual competitor 34 and the real competitor 22. The interactionboundary can be defined by polygon tunnels projected from the virtualcompetitor 34, that may vary in extent, shape, or both extent and shapeaccording to speed and bearing.

When an virtual competitor 34 takes a momentaneous position too close toone of the simulated real competitors 22, one of the polygon tunnelsintersects with the simulated real competitor 22, identifying apotential collision. Upon this occurrence, the AI engine temporarilytakes over control of the simulated real competitor 22, operating it inan autonomous mode. The AI engine can initiate an overtake sequencedetermining whether it is wise to overtake the virtual competitor 34 atthe particular point on the track 20, and whether it can be accomplishedat a sensible speed given the position on the track. If the AI enginedecides to have the simulated real competitor 22 autonomously overtakethe virtual competitor 34, the AI engine performs such an overtakesequence, overtaking the virtual competitor 34. The overtake sequencecan be implemented by recalculating on a frame-by-frame sequence. Whenthe autonomous, simulated real competitor 22 completes the overtakeprocedure, the simulated real competitor 22 is repositioned to theactual position of the real competitor 22 on the track 20 at that timeover a series of frames to provide a smooth and realistic transition.Once the autonomous, simulated real competitor 22 reaches the positionof the real competitor 22 on the track 20, the simulated real competitor22 is once again managed by position data (e.g., GPS data) obtained fromthe real competitor 22.

Alternatively or in addition to such an overtake sequence, the AI enginecan implement other scenarios, in which the simulated real competitor 22is at least temporarily controlled by the AI engine. In someembodiments, such autonomous control of the simulated real competitor 22occurs in response to the virtual competitor 34. Preferably, such AIengine controlled interaction between the virtual competitor 34 and thesimulated real competitor 22 is implemented to provide the virtualcompetitor 34 with a realistic interaction between itself and one ormore of the real competitors 22 within the simulation.

In the exemplary embodiment, the virtual competitor 34 continues torespond to user input, even though the user input would otherwise resultin an unrealistic interaction between the virtual competitor 34 and thesimulated real competitor 22 (e.g., a crash), without sacrificing usercontrol of the virtual competitor 34. Rather, the AI engine manages suchpotential interactions by assuming control of the simulated realcompetitor 22, such that position of simulated real competitor 22 withinthe display at least temporarily varies from the actual position of thereal competitor 22. After a reasonable period of time and whenconditions permit, the AI engine returns the simulated real competitor22 to a position corresponding to the actual position of the realcompetitor 22 on the track 20. Although the exemplary operation of theAI engine is described within the context of interaction of race cars,the AI engine is capable of similarly managing interaction betweenvirtual competitor and simulations of real competitors.

In some embodiments, the AI engine includes additional functionality.For example, in situations in which there may be a substantial dataoutage (e.g., where the lost data is more than the latency time so datainterpolation is not possible), each affected simulated real competitor22 is temporarily controlled in an autonomous mode by the AI engine. TheAI engine translates the simulated real competitor 22 from the lastknown reported position to a control path. In some embodiments, thecontrol path is a best path possible, previously determined for thegiven track 20. Autonomous control proceeds throughout the data outagein a frame-by-frame process, continuing with the last known velocity,bearing, and acceleration. Meanwhile, the simulation software continuesto attempt receiving valid data. After resuming receipt of valid data,the AI engine transitions the autonomously controlled simulated realcompetitor 22, to the actual position of the real competitor 22 on thetrack 20. Once again, this transition from the control path to theactual position of the real competitor 22 can be accomplished by the AIengine in a smooth and realistic way using a frame-by-frame process.

In the above-described embodiments it is assumed that the simulated gameand the real game are performed almost synchronously. However, it is notalways necessary. In a preferred embodiment all position data which aregathered during the competition together with the corresponding timemeasurements are stored in a suitable memory means during thecompetition. Said memory means may function as transfer medium and canbe, after all data are stored, transferred to the system and can be usedby the user at any voluntary moment to take part in the race at a muchlater time. As memory means preferably use is made of a compact discbecause more and more personal computers comprise a CD player. Becausesaid compact disc forms a significant product within the system separaterights are claimed for said compact disc through the attached claims.

Another important component of the system in an embodiment where theinternet is used as communication means is the internet site, where theusers have to log in to obtain the positional data. Also for this site,through which the positional data are made available, and which site ischaracterized thereby, separate rights are claimed through the attachedclaims.

1. System for stimulating events in a real environment containing staticobjects and dynamic objects, comprising; a) position locating means forcontinuously determining, in the real environment, the position of saiddynamic objects in relation to said static objects within a time periodin which the event takes place, b) storage means for storing datadescribing the dynamic and static objects of said environment, c)processing means operatively connected to said position locating meansand said storage means, said processing means for processing b1) datafrom said storage means describing the static and dynamic objects, b2)data from the position locating means indicating at a certain moment themutual position of the static and dynamic objects of the environment,said processing means being loaded with simulation software, d) displaymeans operatively connected to said processing means, said display meansfor displaying a simulated view from a selected viewpoint on thesimulated environment as result of the processing by the processingmeans, e) control means operatively connected to said processing meansand to said display means, said control means to repeat the functioningof processing means and the display means for a range of consecutivetime moments which together determine the above-mentioned time period,wherein, said position locating means comprises a satellite navigationsystem, and the system comprises an environment database in which dataabout a number of possible competition environments are stored so that,after the specific environment where the competition will be held isknown, the stimulation of said environment can be adapted to the choiceof the real environment.
 2. System according to claim 1, characterizedin that the storage means, processing means, and display means andcontrol means are installed as a user terminal at a place remote fromthe real environment and that transfer means are used to transferpositional data from the position locating means to the storage means.3. System according to claim 1, characterized in that for each user ofthe system storage means, processing means, display means and controlmeans are installed as user terminals at a place remote from the realenvironment and that transfer means are used to transfer positional datafrom the position locating means to all said storage means.
 4. Systemaccording to claim 2, characterized in that the internet is used astransfer means.
 5. System according to claim 2, characterized in that atelephone network is used as transfer means.
 6. System according toclaim 1, characterized in that during the whole time period of acompetition all positional data together with corresponding time dataare stored in a memory, which memory can be used after the competitionas transfer medium.
 7. System according to claim 6, characterized inthat the memory is formed by a compact disc.
 8. System according toclaim 1, characterized in that the system comprises a competitorsdatabase in which data about a number a possible competitors are storedso that, after the competitors for a particular event or competition areknow, the simulation of the real competitors within the simulatedenvironment can be adapted.
 9. System according to claim 8,characterized in that data about competitors which are not present inthe competitor database can be transferred through a transfer mediumfrom a suitable source to the system to become stored in said competitordatabase.
 10. System according to claim 8, characterized in that thecompetitors database is integrated into the user terminal.
 11. Systemaccording to claim 1, characterized in that data about an environmentwhich is not contained in the environment database can be transferredfrom a suitable source to the system through suitable transfer means tobecome stored in said environment database.
 12. System according toclaim 1, characterized in that the environment database is integratedinto the user terminal.
 13. System according to claim 1, characterizedin that the simulation of the real environment can be realized by meansof images which are taken from the real environment.
 14. Systemaccording to claim 4, characterized in that at least some events, whichwill happen during the real competition, are stored as separate imagedata in said memory respectively CD, such that these images can bedisplayed at suitable time moments during the simulated competition. 15.System according to claim 1, characterized in that the display means fordisplaying the simulation of at least part of the environment with thedynamic objects therein is formed by a virtual reality helmet. 16.Compact disc for application in a system according to claim 1,characterized in that the compact disc comprises: positional data andcorresponding time data of at least a number of competitors to the realcompetition during at least part of a real competition.